Smooth support vector machine based on piecewise function

doi:10.1016/S1005-8885(13)60100-4

中国邮电高校学报(英文) ›› 2013, Vol. 20 ›› Issue (5): 122-128.doi: 10.1016/S1005-8885(13)60100-4

• Others • 上一篇

Smooth support vector machine based on piecewise function

吴青¹,范九伦²

1. School of Automation, Xi’an University of Posts and Telecommunications, Xi’an 710121, China 2. School of telecommunication and information engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, China

收稿日期:2013-01-21 修回日期:2013-06-21 出版日期:2013-10-30 发布日期:2013-10-29
通讯作者: 吴青 E-mail:xiyouwuq@126.com
基金资助:
This work was supported by the National Natural Science Foundation of China (61100165, 61100231, 61105064, 51205309), the Natural Science Foundation of Shaanxi Province (2012JQ8044, 2011JM8003, 2010JQ8004), and the Foundation of Education Department of Shanxi Province (2013JK1096).

Smooth support vector machine based on piecewise function

1. School of Automation, Xi’an University of Posts and Telecommunications, Xi’an 710121, China 2. School of telecommunication and information engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, China

Received:2013-01-21 Revised:2013-06-21 Online:2013-10-30 Published:2013-10-29
Contact: Qing Wu E-mail:xiyouwuq@126.com
Supported by:
This work was supported by the National Natural Science Foundation of China (61100165, 61100231, 61105064, 51205309), the Natural Science Foundation of Shaanxi Province (2012JQ8044, 2011JM8003, 2010JQ8004), and the Foundation of Education Department of Shanxi Province (2013JK1096).

摘要/Abstract

摘要： Support vector machines (SVMs) have shown remarkable success in many applications. However, the non-smooth feature of objective function is a limitation in practical application of SVMs. To overcome this disadvantage, a twice continuously differentiable piecewise-smooth function is constructed to smooth the objective function of unconstrained support vector machine (SVM), and it issues a piecewise-smooth support vector machine (PWESSVM). Comparing to the other smooth approximation functions, the smooth precision has an obvious improvement. The theoretical analysis shows PWESSVM is globally convergent. Numerical results and comparisons demonstrate the classification performance of our algorithm is better than other competitive baselines.

关键词: SVM, smooth technique, piecewise function, bound of convergence

Abstract: Support vector machines (SVMs) have shown remarkable success in many applications. However, the non-smooth feature of objective function is a limitation in practical application of SVMs. To overcome this disadvantage, a twice continuously differentiable piecewise-smooth function is constructed to smooth the objective function of unconstrained support vector machine (SVM), and it issues a piecewise-smooth support vector machine (PWESSVM). Comparing to the other smooth approximation functions, the smooth precision has an obvious improvement. The theoretical analysis shows PWESSVM is globally convergent. Numerical results and comparisons demonstrate the classification performance of our algorithm is better than other competitive baselines.

Key words: SVM, smooth technique, piecewise function, bound of convergence

中图分类号:

TP391

WU Qing FAN Jiu-lun. Smooth support vector machine based on piecewise function[J]. Acta Metallurgica Sinica(English letters), 2013, 20(5): 122-128.

参考文献

1. Burges C J C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 1998, 2(2): 121-167

2. Zhang Y, Cai J. A support vector classifier based on vague similarity measure. Mathematical Problems in Engineering, 2013, ID 928054/1-7

3. Baccarini L M R, Silva V V R, Menezes B R D, et al. SVM practical industrial application for mechanical faults diagnostic. Expert Systems with Applications, 2011, 38(6): 6980-6984

4. Li K L, Xie J, Sun X, et al. Multi-class text categorization based on LDA and SVM. Procedia Engineering, 2011, 15: 1963-1967

5. Spinosa E J, Carvalho A C. Support vector machines for novel class detection in Bioinformatics. Genetics and Molecular Research, 2005, 4(3): 608-615

6. Yuan Y B. Forecasting the movement direction of exchange rate with polynomial smooth support vector machine. Mathematical and Computer Modelling, 2013, 57(3/4): 932-944

7. Zheng J, Lu B L. A support vector machine classifier with automatic confidence and its application to gender classification. Neurocomputing, 2011, 74(11): 1926-1935

8. Zhou X, Wang Y, Wang D L. Application of kernel methods in signals modulation classification. The Journal of China Universities of Posts and Telecommunications, 2011, 18(1): 84-90

9. Zhao Z C. Combining SVM and CHMM classifiers for porno video recognition. The Journal of China Universities of Posts and Telecommunications, 2012, 19(3): 100-106

10. Lin H J, Yeh J P. Optimal reduction of solutions for support vector machines. Applied Mathematics and Computation, 2009, 214(2): 329-335

11. Christmann A, Hable R. Consistency of support vector machines using additive kernels for additive models. Computational Statistics and Data Analysis, 2012, 56(4): 854-873

12. Shao Y H, Deng N Y. A coordinate descent margin based-twin support vector machine for classification. Neural Networks, 2012, 25(1): 114-121

13. Lee Y J, Mangarasian O L. SSVM: A smooth support vector machine for classification. Computational Optimization and Applications, 2001, 22(1): 5-21

14. Yuan Y B, Yan J, Xu C X. Polynomial smooth support vector machine. Chinese Journal of Computers, 2005, 28(1): 9-17 (in Chinese)

15. Yuan Y B, Huang T Z. A polynomial smooth support vector machine for classification. Proceedings of the 1st International Conference on Advanced Data Mining and Applications (ADMA’05), Jul 22-24, 2005, Wuhan, China. LNCS 3584. Berlin,Germany: Springer-Verlag, 2005: 157-164

16. Xiong J Z, Hu J L, Yuan H Q, et al. Research on a new class of functions for smoothing support vector machines. Acta Electronica Sinica, 2007, 35(2): 366-370 (in Chinese)

17. Purnami S W, Embong A, Zain J M, et al. A new smooth support vector machine and its applications indiabetes disease diagnosis. Journal of Computer Science, 2009, 5(12): 1003-1008

18. Yuan Y B, Fan W G, Pu D M. Spline function smooth support vector machine for classification. Journal of Industrial and Management Optimization, 2007, 3(3): 529-542

19. Yuan B L, Zhang W J, Wu H. New solution method to smoothing support vector machine with one control parameter smoothing function. Proceedings of the 2nd WRI Global Congress on Intelligent Systems (GCIS’10): Vol 2, Dec 16-17, 2010, Wuhan, China. Piscataway, NJ, USA: IEEE, 2010: 153-154

20. Xu C X, Zhang J Z. A survey of quasi-Newton equations and quasi-Newton methods for optimization. Annals of Operations Research, 2001, 103(1/2/3/4): 213-234

21. Bertsekas D P. Nonlinear programming. 2nd ed. Belmont, MA, USA: Athena Scientific Press, 1999

[1]	鄂海红童俊杰宋美娜宋俊德. QoS prediction algorithm used in location-aware hybrid Web service[J]. Acta Metallurgica Sinica(English letters), 2015, 22(1): 42-49.
[2]	郑海波朱秀昌. Sampling adaptive block compressed sensing reconstruction algorithm for images based on edge detection[J]. Acta Metallurgica Sinica(English letters), 2013, 20(3): 97-103.
[3]	李雷达，郭宝龙，郭磊. Rotation, scaling, and translation invariant image watermarking using feature points[J]. Acta Metallurgica Sinica(English letters), 2008, 15(2): 82-87.
[4]	刘知青;窦青. Automatic acquisition of pattern collocations in GO[J]. Acta Metallurgica Sinica(English letters), 2008, 15(1): 61-67.
[5]	张登银;陈家平;孙俊才. Design and implementation of improved watermarking system in WT domain[J]. Acta Metallurgica Sinica(English letters), 2007, 14(2): 58-63.
[6]	ZHANG Li-he, KONG Xiang-wei, YANG Cheng. Digital rights management independent of terminals in mobile applications[J]. Acta Metallurgica Sinica(English letters), 2007, 14(1): 32-38.
[7]	LIU Zhi-qing, DOU Qing. Automatic pattern acquisition from game records in GO[J]. Acta Metallurgica Sinica(English letters), 2007, 14(1): 100-105.

Smooth support vector machine based on piecewise function

Smooth support vector machine based on piecewise function

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 7

编辑推荐

Metrics

本文评价